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Abstract. Large scale optimization problems are tractable only if they are somehow decomposed. 
Hierarchical decompositions are inappropriate for some types of problems and do not parallelize 
well. Sobieszczanski-Sobieski has proposed a nonhierarchical decomposition strategy for nonlinear 
constrained optimization that is naturally parallel. Despite some successes on engineering prob- 
lems, the algorithm as originally proposed fails on simple two dimensional quadratic programs. 

This paper carefully analyzes the algorithm for quadratic programs, and suggests a number of 
modifications to improve its robustness. 

1. Introduction. 

Many engineering problems involve large scale optimization over many different disciplines. 

As is the case with many large scale problems, a decomposition of the problem into subproblems 
helps reduce the time and complexity of solution. The strategy governing the decomposition of 
a large scale problem can directly affect the ease and accuracy of the solution. The concept of 
a linear decomposition strategy [23] has been used with good results in a number of cases. This 
method works very well in the case of a system that is amenable to such a decomposition, i.e., when 
subsystems can be laid out clearly in a linear fashion. For this there should be a basic hierarchy 
embedded in the problem. 

For a system with many interdependencies between the probable subproblems, using a linear 
decomposition strategy implies choosing one subsystem before another, thereby establishing an 
artificial hierarchy. The order chosen will affect the solution iterates, making this strategy illsuited 
or even nonconvergent for such nonhierarchic problems. 

These considerations led Sobieski [22] to propose a new nonhierarchic decomposition strategy. 

Since nonlinear optimization can be reduced to a series of quadratic programs, it is appropriate to 
study this new algorithm first on quadratic programs. Thus, this paper first studies the various 
tuning parameters occurring in this algorithm, using a model quadratic programming problem. A 
series of experiments shows that modifications to the algorithm as originally proposed by Sobieski 
[22] are necessary for convergence. This modified algorithm is then used to solve problems involving 
a number of subsystems, each with a varying number of design variables. 
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The tests are carried out on quadratic programming (QP) problems of different dimensions. 
The decomposition then yields subproblems which are also QP problems. The method employed 
to solve these smaller QP problems is elimination of variables [8]. Also optimization packages such 
as MINOS [17] and QPSOL [12] were used to verify the correct answers. 

A detailed description of the original algorithm, modifications to it, tabulations of the results 
obtained for the test problems of different dimensions, and analysis of the results are presented. 

2. Problem Statement. 

Consider the following nonlinear programming problem (NLP), 

min0(x) 

X 

subject to g(x, y ) < 0, 

h(x, y) = 0, 

where x E E n , y E E p , g is an m-dimensional vector function and h is a p- dimensional vector 
function, x is the set of design variables and y is the set of behavior variables which are the 
unknowns in each subsystem. 

The approach (known as subspace optimization) is to solve this problem by solving a set of 
subproblems. To outline the differences between the current scheme and simple decomposition, we 
introduce the following terminology: 

i = (I 1 ,X 2 ,...,I JV ), X'EE ni , «i +n 2 + . . . + rcjv = n, 

y = (Y\Y 2 ,...,Y N ), y * E E pi , Pl +P 2 + ■ ■ ■ + Pn = P, 



h i (x,y)EE Pi , g'(x,y)EE mi , mi + . . . + m N = m, 

h\x, y) = y - ~ti (*, y 1 , . . . , y*- 1 , y i+1 , . . . , y") . 

The sub vector X' is the set of design variables corresponding to the ith subsystem. Similarly 
the sub vector Y' is the set of behavior variables of the ith subsystem. For any vector function 
f(x,y), let f{X\Y { ) denote / with all the components X 1 , . . ., X* -1 , X‘ +1 , . . ., X N , Y 1 , 
yi-i } yi+1 ,", y Y N fixed except for X' and Y\ Note the assumption that each Y { can be explicitly 
determined in terms of x and the other subvectors Y 3 . 

3. Simple Sequential Decomposition. 

The approach is to first divide the given large problem into a set of independent subproblems, 
corresponding naturally to the subsystems comprising the larger system. The ith subsystem would 
be 

min0(X*) 

subject to ^(X*,y‘) <0, 
h i {X\Y i )= 0, 
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where the system of equalities h l — 0 is used to eliminate Y l from g*. The subproblems are solved 
sequentially for * = 1, . . . , N, with one pass through all the subsystems constituting one outer itera- 
tion. The outer iterations are repeated until the same point (z, y ) solves all N subproblems. While 
solving the ith subsystem the values of X 1 , . . . ,X‘ _1 , X*"*" 1 , . . ,,X N , Y 1 , . . . ,Y i 1 , T ,+1 , . . ■ , Y N 
are fixed. They can be chosen in a Gauss- Seidel manner where the first i — IX and Y subvectors 
used have their latest values from solving the first i — 1 subproblems. A parallel algorithm, solving 
the subproblems concurrently, would use a Jacobi scheme where the values of all the X 3 and Y 3 
vectors are updated only at the end of each major outer iteration. The ensuing discussion assumes 
a Jacobi scheme. 

4. Decomposition with Approximate Coupling. 

In the scheme proposed by Sobieski [22], a measure of the constraints in each of the other 
subsystems is also brought into the ith subsystem in the form of one cumulative constraint C k per 
subsystem. The approximate cumulative constraint C k of the Arth subsystem in the ith subsystem 
is obtained from the corresponding constraints g k € E mk as a linearization of the Kreisselmeier- 
Steinhauser cumulative constraint 


The p in the Kreisselmeier-Steinhauser function is a constant used to control the accuracy of the 
cumulative constraint approximation. The linearization of this cumulative constraint of the fcth 
subsystem with respect to the variables of the ith subsystem is 

c!{x>,y<) = K t (xiX) + jr (xj - (xj),) . 

j= 1 3 

In the ith subsystem the cumulative constraints of the other subsystems are brought in as 
constraints. Therefore, a violated cumulative constraint of one subsystem may be satisfied by 
decisions taken in every one of the other subsystems. Therefore, we introduce coefficients r? to 
represent the fractional “responsibility” assigned to the ith subsystem for reducing the violation 
of the cumulative constraint of the pth subsystem, for each p = 1 Thus we have TV 2 

r-coefficients. The rf’s are defined in such a way that 

N 

E r ? = 1 ' 

i=l 

Sobieski [22] suggested the initialization of the r-coefficients in such a way that they are proportional 
to the degree of influence exerted by the ith subsystem on the pth cumulative constraint. This 
initialization is discussed in the Appendix. 

To further reduce the objective function we allow cumulative constraints to be violated in one 
subsystem, provided that the violation will be offset by oversatisfaction of that constraint in another 
subsystem. To account for such tradeoffs, we introduce the N 2 coefficients , corresponding to 
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the cumulative constraint of the pth subsystem when present in the ith subsystem. For the pth 

cumulative constraint, 

N 

i=l 

maintains the constraint at a value of zero. This condition and the condition on the r-coefficients 
are enforced in what is called the coordination optimization phase, which is solved to update the 
values of the r’s and the fs at the end of every outer iteration. The Jf’s are initialized at the 
beginning of the algorithm to zero. 

As has been described above, the rj” s are needed only in the case of a violation and the 
only when the constraints are critical, therefore only one of the two is needed at a time. 
Therefore we introduce N coefficients s p which act as switches, one for each of the cumulative 
constraints of the subsystems. s p is set to one (activating the r-coefficients) if the corresponding 
constraint K p < 0 is violated at the outset of the system optimization procedure and stays at 
one until the K p is driven to a critical status (zero value). Once K p becomes critical, s v is reset 
to zero (activating the ^-coefficients) and stays at zero until the system optimization procedure 
terminates. The switch s* is applied selectively to the natural constraints g * of the ith subsystem 
(i.e., the constraints that are assigned to the ith subsystem) by multiplying the r - coefficient rj by 
a factor of max{£*(Xo,lg),0}, so that constraints which are already satisfied are not taken into 
consideration. 

Thus, the ith subsystem optimization problem is 

min0(X*) 

x i 

subject to ^(X^Y*) < 5 i max{^(AS f yo i ),0}(l - r\) + (1 - s^t), 

Cf(*\r) < KriX^Yj) s p (l - if) + (1 - 

p — 1,. . 1, t + lj ■ • ■ » X, 

^(X^Y*) =0. 


The constrained minimum of 0 obtained from each subsystem optimization is a function of 
the constants rf and tf, and its partial derivatives with respect to rf and if (assuming they exist) 
can be computed from the expressions given in the Appendix using gradient information for the © 
and C functions. These derivatives are used for a linear approximation of 0 that is the objective 
function for the coordination optimization phase , the last (and synchronizing) step of an outer 
iteration. 

The coordination optimization phase (COP) solves a linear program to adjust the coefficients 
rf and if, so that the objective function 0 will be further reduced (if possible) at the end of the 
next outer iteration. The linear program uses a linear extrapolation of 0 based on the partial 
derivatives dO/dz described above. Here z represents either an r or a t coefficient. Move limits 
(upper and lower bounds Uf, Uf, Lf and Lf for rf and if, respectively) are needed to prevent 
large changes in the r- and ^-coefficients caused by the nonlinearity of the original problem. For 
the first COP execution, the rf ’s may be initialized as already suggested and the if ’s are initialized 
to zero. For every subsequent execution, the rf ’s and the <f ’s are initialized to the terminal values 
from the previous COP execution. The result of the COP execution is a new set of rf’s and 
if’s to be used in the next outer loop of subsystem optimizations. The adjustment of the rf’s 
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and tf’s to the new values amounts to a reassignment of the responsibility for eliminating the 
constraint violations among the subsystems and to issuing a new set of instructions about trading 
the constraint violations/oversatisfactions among these subsystems. Let (xo,yo) be the current 
updated point (the result of the Jacobi outer iteration) and 


JV JV M N N 

0, = 0(xc, ft) + E £ w M + £ £ w At *' 

p - 1 t=l * p=l i=l * 


where Arf = (rf - (rf) 0 ) and Atf = (tf - (t?)o)- The partial derivatives dO/dr f and 80/ dt? are 
evaluated at the optimal point computed by the ith subsystem optimization. Let 


and 


R=(r\,‘ 


ll 


r N r 1 
- ? r l j r 2> - 


r N 
■ ) r 2 ? 


7"» __ /'/l /2 ,1 uN 



•j l N> • 



Then @i is a function of R and T. The linear program solved during the coordination optimization 
phase is: 

min ©I (R’ T ) 


N 

subject to ^ t\ = 1, 
fc=l 
N 

£<J = °. 

fc=i 

0 < r* < 1, 

Ll <r P k < VI 

% < tl < VI 


P = 1,...,JV, 

P = 

p = l,...,JV, k = l,...,N, 
p=l,...,N, k = l,...,N. 


5. Pseudocode for algorithm. 

An algorithmic description of the whole process in pseudo-code is given next, using the fol- 
lowing model quadratic programming problem (without the variables y and equality constraints 
h(x,y) = 0) for specificity: 

min x x Ax 

X 

subject to Bx < d, 


where 

/ An 

oiuAu 

(*inAin\ 


£11 

PnBu 

... PinBin\ 

I ai2-Aj 2 

A22 

■ &2N A2N 

, B = 

P21B21 

B 22 

. . . P2NB2N 

H ; 

; 

; 

m 

• 

* , | 

\ Qt\ 

<X2 NA\ n . . . 



\PniBni 

PmBm 

• • • -07VJV ' 


( d i\ 


( X '\ 


1 

. X 2 

• 

H 

II 

9 

\djv/ 

1 

\X N ) 
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and X* e E n * , A tJ - £ E niXn ’ , Bij £ E ViXn ’ , di £ E Vi , the A* are symmetric and positive definite 
and the ctjj, fiij are fixed “coupling” parameters, for all i,j = Using notation defined 

in the Appendix, pseudo-code for the algorithm applied to this quadratic programming problem 
(QP) is: 

Choose an initial estimate x and initialize the r-, s- and coefficients; 

Repeat until minimum reached 
begin 

for i = 1 to N do 
begin 

Calculate the linearization C/(X‘) of the cumulative constraint for the jtli subsystem, for 
all j ^ i\ 

Calculate the ith subsystem’s self responsibility 

S* = S max {? (X^Yj) ,0} (l - rj) + (l - s<) 

Solve the QP (zth subsystem) 


min 0 (X’) = (X^AuX* + 2 (^^(X^A,^ 


AT 


subject to ^^(3ijBijXi — di < 6', {fin = 1 ) 
i=l 

Cj (X') < 0, for all j ± i\ 


Calculate (if not already available) the Lagrange 
the Appendix. 

50 50 . AT 

Calculate — r and — 7 for j = 1 , . . . , J \ ; 

8r\ dt\ 


end 

Solve the LP (Coordination Optimization Phase) 


multipliers A using the method given 


in 


min ©l (R> T ) 

rC,i 


N 

subject to = 1 , 

k= 1 

0 < rl < 1 , 


N 


]T^fc = 0 > P=1,...,N, 


k=l 


L p k <r p k < U p , L p <t p < U p , 




end (repeat) 

6. Initial tests. 

Testing of this algorithm was first performed on a simple 2x2 case: 
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Example 1. 


min x\ + x 2 

X 

subject to x\ + /?x 2 < 4, 
fixi + x 2 > 2, 
where x = (xi,X 2 )* G -E 2 . 

Here each constraint is taken to be in a subsystem by itself with Xi_= (xi) and X 2 = (x 2 ). The 
results are tabulated in Table I. The column headings are the starting points, the last column 
gives the solutions for the different values of /?, and each entry contains a convergence code and 
the number of iterations taken. The code IF means an infeasible subproblem is encountered at 
the very first iteration and the procedure is terminated, R means the solution is reached in the 
iteration indicated, but subsequently an infeasible subproblem is encountered, WR means a wrong 
point is reached before an infeasible subproblem causes termination, 0 means there is oscillation 
through the number of iterations indicated, WC means there is convergence to a point other than 
the solution, and NC means there is no convergence even after the number of iterations indicated. 


Table I 

Original algorithm applied to the 2x2 case. 


p 

(2,3) 

( 4 ,- 1 ) 

(1,-1) 


(10,3) 

solution 


R 

b 

R 

n 

R 

1 

R 

1 

R 

1 

(0.0, 2.0) 



B 

E9 

n 


B 


B 

IF 

1 

(0.198,1.98) 



B 

El 

D 


B 


B 

IF 

1 

(0.55,1.835) 

0.5 


B 


B 

0 

150 

NC 

150 

WR 

1 

(0.8, 1.6) 


0 

150 

0 150 

0 

150 

0 

150 

0 

150 

(1.0, 1.0) | 


As can be seen from the table, the main problem with the algorithm is not being able to 
deal with infeasibility in a subproblem. Another reason for the algorithm not being successful is 
the way the s coefficient is set permanently to zero once a constr aint becomes critical. When a 
constraint that was once critical becomes violated, the r coefficients cannot be brought in to reduce 
the violation. 

7. Modifications to the original algorithm. 

Several modifications and variations of the original algorithm as described in [22] are discussed 
next. The order of the topics is not significant. 

Changes in setting of the switch coefficients s p . 

When a K p becomes critical, the corresponding s p is set to zero and stays at zero until the 
whole procedure terminates. This means that the term with the r p coefficient does not contribute 
any longer to the constraints. If the constraint becomes violate d later , then the violation cannot 
be reduced using the r coefficients. Hence two alternatives to thejdgorithm were considered. One 
was to remove the s coefficient from the r term. The other was to s et the s p coefficient at the end 
of every outer iteration depending on whether the corresponding constraint was satisfied or not. 
This would make one of the r or t coefficients active all the time. The, second alternative performed 
better in initial tests and therefore was selected. 
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Handling Infeasibility. 

Because of the linearization and the allocation of responsibility, some subproblems may be 
infeasible. The following procedure is employed to recover from infeasibility in a subsystem. A 
new variable u is introduced in each of the constraints and a large multiple of this variable is added 
to the objective function to be minimized. Thus, the corresponding sub problem would now be 

min0(A‘) + Mw 

x * 

subject to FiX^Y*) -u < - rj) + (1 - s% 

Cf(X\ r) - « < K P (X*, Yj) s?( 1 - rf) + (1 - 

p = 1, • ■ • » * !»* + !»•■•» X, 


where M is a large positive number. 

The linear objective function in the Coordination Optimization Phase is formed using the 
Lagrange multipliers obtained from the subproblems. The introduction of the variable lo affects 
these Lagrange multipliers. The sensitivity derivatives are affected considerably because of these 
Lagrange multipliers, as indicated in the Appendix. A thought as to whether this was justified or 
not led to two variations of the algorithm. In the first variation, in case of an infeasibility in any 
subproblem, the Coordination Optimization Phase is omitted at the end of that outer iteration. 
In the second variation, the COP is included in every outer iteration. 

Limit on t coefficients . 

Initially tests were performed with the t coefficients left unbounded, but clearly this is unwise. 
A few variations for the bounds on the f’s were considered. One possibility is keeping the bound 
fixed throughout the procedure, but this may result in nonconvergence to the solution. Also the 
bounds should not decrease too fast, because this may force convergence to a nonoptimal solution. 

The bound is reduced by a factor of / = 0.8 at the end of every outer iteration. Thus, if the 
bound at the first iteration is ti , then the bound at the mth iteration is 

t m = 0 

A variation of having the bound at the mth iteration equal a factor / *°s( m_1 ) or a factor 
y(m-i) 1/3 tfie bound at the first iteration was also considered. 

A later modification was to change the move limits on the t coefficients based on information 
about the corresponding coefficients in the objective function of the COP. To ensure that no 
subsystem is allowed a violation that cannot be offset by an equivalent oversatisfaction in the 
other subsystems, a change was made to the move limits on the t coefficients, using information 
about the corresponding sensitivities . 

The a pk coefficient (as described in the Appendix) is a measure of the sensitivity of the 
pth cumulative constraint to the variables of the fcth subsystem. The lower limit of t\ is now 
max{— a pfc , — tlim }, reasoning that the oversatisfaction expected of the pth cumulative constraint 
in the Jfcth subsystem will be restricted to what it can handle. 

The initial value of the move limit on the t coefficient affects the results and the path taken. 
Various values of this initial limit were tried. 

At the beginning of every major iteration involving a new />, the initial value of the move limit 
on the t coefficient may be reset to either the original value or some fraction of it. 
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Convergence Criterion. 

The convergence criterion initially involved a measure of the difference between three successive 
iteration values of the design vector. Later, tests revealed that with this criterion the procedure 
could stop even if there was a chance for further improvement, because of changes in the values of 
the r and t coefficients. Hence the difference between the values of the t and r coefficients were 
also included in the convergence criterion. Thus, if 5 m _ 2 represents the normalized form of the 
vector (x, R,T) at the (m - 2)th iteration and similarly for 5 m -i and S m , then using the 2-norm 
the convergence criterion is 

||5»-i - S m - 2 II + \\Sm ~ S«-i|| < 0.0001. 

Changes to the p coefficient. 

After the required convergence criterion is met the p coefficient is increased and the whole 
process is repeated again to check if the convergence criterion is still met, if not another major 
iteration is performed. This is because with increasing p the cumulative constraint is closer to the 
actual constraints. But the process is not started with a large />, as the problem is then very ill 
conditioned. 

Cross derivatives . 

The cross derivatives are checked to see if one subsystem is at all dependent on the variables 
of another subsystem, if not the corresponding r and t coefficients are fixed at zero. 

Changes to the r coefficients. 

The diagonal r coefficients r\ are assigned a minimum value of 0.2 always, reasoning that every 
subsystem always has some responsibility towards its own constraints. 

No COP. 

If the objective function of the COP is a constant then the COP is skipped for that iteration. 
Resetting the t coefficients . 

It was observed in one case that t coefficients (corresponding to one subsystem’s constraint) 
with equal derivatives in the objective function of the COP assigned extreme values to the corre- 
sponding t coefficients even though there was no contribution to the objective function. Hence, 
after the COP a check is performed on the t coefficients to see if for a particular p the sum of the 
contributions of all the corresponding coefficients to the objective function of the COP is zero. If 
so all the t coefficients corresponding to this p are forced to be zero. This check is performed for 
all values of p. 

Different combinations of these modifications were used on the following test problems and 
the results are given in the tables following them. 

8. Further tests. 

The original algorithm as proposed by Sobieszczanski-Sobieski [22] did not prove to be suc- 
cessful as indicated by Table I. Results of two of the most successful variations to this algorithm 
tested on the 2 x 2 case are tabulated in Tables II and III. The characteristics of the algorithms 
used are given above the corresponding tables. updated” indicates that the s coefficient is 
updated at the end of every outer iteration as indicated in the modifications given in Section 7. 
“u; used” means that an artificial variable u was introduced to deal with infeasible subproblems. 
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The inclusion or exclusion of the COP is in the case of an infeasibility in any subproblem. The 
limit on the magnitude of the t coefficient is bounded at 1 initially and this bound is decreased by 
using a factor of 0.8 as described in Section 7. The most successful version was used for larger test 
problems like the 3x3 case with two subsystems and the 6x6 case with three subsystems. The 
tests were carried out for five different values of / 3 and for five different starting points. The column 
headings are the starting points, the last column gives the solutions for the different values of /?, 
and each entry contains a convergence code and the number of iterations until the two-norm of the 
change in (x ,R,T) is less than 0.0001 . The code C means there is convergence to the solution, 
WC means there is convergence but not to the solution, and NC means there is no convergence 
even in the specified number of iterations. 


Table II 

s updated, u used, no COP, 
t bounded at 1 and 0.8 update . 



(2,3) 

(4,-1) 

(1,-1) 

(0.8, 1.5) 

(10,3) 

solution 

0.0 

C 6 

C 6 

C 6 

C 

6 

C 

6 

(0.0, 2.0) 

0.1 

C 56 

C 54 

C 53 

C 

53 

C 

55 

(0.198,1.98) 

0.3 

C 50 

C 57 

C 51 

c 

52 

C 

44 

(0.55,1.835) 

0.5 

C 7 

C 55 

C 42 

c 

48 

c 

49 

(0.8, 1.6) 

1.0 

C 7 

C 8 

C 7 

c 

47 

c 

46 

(1.0, 1.0) 


Table III 

s updated, u> used, COP, 
t bounded at 1 and 0.8 update . 


0 

(2,3) 

(4,-1) 

(1,-1) 

(0.8, 1.5) 

(10,3) 

solution 

0.0 

C 6 

C 6 

C 6 

C 

6 

C 

6 

(0.0, 2.0) 

0.1 

C 56 

C 53 

C 53 

C 

53 

C 

56 

(0.198,1.98) 

0.3 

C 50 

C 50 

C 51 

C 

52 

C 

50 

(0.55,1.835) 

0.5 

C 7 

C 45 

C 42 

C 

48 

C 

49 

(0.8, 1.6) 

1.0 

C 7 

C 8 

C 7 

c” 

47 

C 

46 

(1.0, 1.0) 


Example 2. 


min x\ + x\ + x\ 

X 

subject to zj + 12 + P x 3 < 4, 

—Xi — X2 — fa 3 < — 2 , 

— (3x\ — fixi — 5*3 < —2, 
where x = e E 3 
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Table IV 

s updated, u> used, COP, 
t bounded at 1 and 0,8 update. 


0 

(0,1, -3) 

( 1 , 1 , 0 ) 

(4, 0.1, 0.8) 

(-10,3,-10) 

(0,0,0) 

solution 

0.0 

C 

6 

C 

6 

C 

6 

C 

6 

c 

6 

(1,1, 0.4) 

0.1 

C 

60 

c 

60 

c 

59 

C 

60 

c 

59 

(0.9819,0.9819,0.3607) 

0.3 

C 

55 

c 

56 

c 

56 

C 

56 

c 

56 

(0.9569,0.9569,0.2870) 

0.5 

WC 

54 

c 

45 

WC 

54 

C 

47 

WC 

56 

(0.8888,0.8888,0.4444) 

1.0 

c 

47 

c 

46 

c 

46 

WC 

51 

c 

44 

(0.6666,0.6666,0.6666) 


Here, the first two constraints belong to one subsystem and the third constraint to another sub- 
system, X 1 = ( 21 , 22 ) and X 2 = (23). 

It was observed that changing the initial value of the bound on t affects the convergence of 
the algorithm. For the WC entries in Table IV corresponding to /? = 0.5, starting with a bound of 
100 on t results in convergence to the solution for two of the three cases, and 1000 works for the 
third case. An initial bound of 10 for t leads to convergence to the solution for the WC case with 
(3 = 1.0. However, initial bounds of 10, 100, or 1000 cause failure for other cases in Table IV. 

Example 3. 


min x \ + 23 + x 2 + 2.624 + 2.625 + 102g 

X 

subject to x\ + X 2 + £3 + 0 — (3xs — 2/?£6 < 4, 
-X\ - X2 — X 3 — / 3 X 4 + 0 + 0 < —2, 
— X\ — X 2 — 5x3 -f- 0 0 -f- 0 ^ — 2, 

0 + 0 + 0 + X 4 + X 5 — /3x 6 < —4, 
/3xi + /3 x2 + 0 — 5 x 4 — 4 x 5 — /3x6 < 20, 
/3xi + /3x 2 - fix 3 + 0 + 0 - x 6 < -6, 
where x = (xi,X 2 ,X 3 ,X 4 ,X 5 ,x 6 ) i G E 6 
Here there are three subsystems with n\ — 3, n 2 = 2 and 03 = 1. 
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Table V 

s updated u> used , COP, 
t bounded at 1 and 0.8 update. 


13 

(0,0,0, 

0,0,0) 

(1,2,3, 

-1,1,5) 

(-10,4,4, 
0.8, 0.1,1) 

(1,1,1, 

1,1,1) 

(-4,2,2, 

0,1,1) 

solution 

0.0 

C 6 

C 6 

C 

6 

C 6 

C 6 

(0.6,0.6, 0.6, -2. 0,-2. 0,6.0) 

0.1 

WC 46 

WC 80 

WC 

48 

NC 70 

WC 48 

(-2.4, -2.4, 7.0, -1.7, -1.8, 4.8) 

0.3 

WC 51 

NC 70 

WC 

50 

NC 70 

WC 50 

(-2.7, -2.7, 8.0, -1.5, -1.8, 1.9) 

0.5 

WC 52 

NC 70 

WC 

53 

NC 70 

WC 53 

(-1.7, -1.7, 6.3, -1.5, -1.9, 1.0) 

0.5 

WC 16 

WC 7 

WC 

13 

NC 70 

WC 13 

(-0.5, -0.5, 4.2, -1.2, -2.0, 0.7) 


Appendix* 

Initialization of the r- coefficients. 

The coefficients may be initialized on the basis of sensitivity information so as to assign a 
greater responsibility for a cumulative constraint satisfaction (of the ith subsystem say) to those 
subsystems that have a greater influence on that constraint. Let 

( K pk)i = 

Since 1 < p < N, 1 < k < N, and 1 < i < n k , there are Nn k such partial derivatives (K pk )i, for 
every k. Now define 


a pk = max I (-fiTpjt)* I ? 1 < P < IV, 

which measures the influence of the fcth subsystem’s variables X* on the pth subsystem s con- 
straints, as represented by K v . Normalizing these N 2 influence coeflicients gives the r-coefficients 


rP - 


~pk 


'k- N 
i=i 


1 < p < N, 1 < k < N. 


Optimum Sensitivity Analysis. 

Let z denote either of rf or tf, and define the modified constraint functions 

g^X^Y 1 ) = § i (X i ,Y i ) - [«* max{^*(Xo,lo),0}(l — rj) + (1 — , 

Cf (XSr) = Cf (X^Y*) - \K P (Xi,Y*) s?( 1 - rf) + (1 - s?)*?] , 

i = 1,..., N, P = !)•••)* 1, * + !)■■■> 
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LetVi (ax; ’ ‘ ‘ ‘ ’ dxi . ) 




G' = 


c\r 1 

c\ +1 


\cH 


and G*a denote the subvector of G x corresponding to the active constraints at the current point. 
It is assumed that the dimension of (7^ is less than or equal to ti** an d that the Jacobian matrix 
ViG\ has full rank. Then the sensitivities of the minimum of 0 with respect to the constraints 
g* <0 ? < 0 are given by the Lagrange multipliers 


A = - [(V^HV^)*]' 1 (ViG' A ) (Vj©) 4 , 

where everything is evaluated at the current point — the result of the JVth subsystem optimization. 
Now from this the sensitivities of the minimum of 0 with respect to the rf and tf are given by 


90 t dG\ 
dz~ dz ' 

Observe that from the form of G\ the partials dG\fdz are trivial to compute. A would not 
be computed explicitly from the projection operator as described above, but rather from a QR 
factorization of (V iG'^j , as described in Fletcher [8]. 
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